UMA: Unreliable Market Assumption Protocol 


Prediction market rules ambiguity has been a problem for a while. Recently Polymarket 


outsourced this work to the optimistic oracle UMA. There was a critical vote on the optimistic 


oracle UMA protocol. This vote undid over 100 markets of precedent on Polymarket and is an 
excellent example of why any complex protocol that wants consistent resolutions on specifically 


hard-coded rules in ancillary data will avoid the UMA protocol. 


The market in question: 


httos://polymarket.com/market/will-eth-be-above-1600-on-august-26 


Rules Polymarket provided to the UMA optimistic oracle: 


This market will resolve to “Yes” if Ethereum (ETH) has a candlestick closing price of $1,600.01 
or more, as per the resolution source, on August 26, 2022, 12 PM ET, and “No” otherwise. The 
resolution source for this market will be prices listed on CoinGecko 
(https:/www.coingecko.com/en/coins/ethereum). This market will resolve according to the “C” 
(i.e. closing price) listed for the candle titled “Fri Aug 26 2022, 12:00:00”, with the “Price” tab 
selected, in the Eastern Time Zone. Note, this 12:00:00 candle lists the opening price for 
11:30:00 AM ET and the closing price for 12:00:00 PM ET. 


When the candle closed and the next candle began, This was the screenshot all over UMA 
discord on August 26th. 
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Multiple people in the UMA discord verified and screenshotted this data point in real-time when | 
proposed that Eth finished over 1,600. The market was trading at 99.5c, for yes, at that time. 


Someone disputed, asking UMA to weigh in on the ruling. 


Precedent: 
1. 
Two other markets had been proposed where Coingecko data did not match many people’s 


visions of consistent reality. 


https://polymarket.com/market/will-tether-usdt-fall-below-98-cents-by-july-30 


The market above is similar to the ETH 1,600 market. No Uman dispute occurred as all 
Polymarket participants agreed the resolution source did not show a candle under 98c. Based 


on the recent ruling, this surely should have been disputed. 


https://www.businesstoday.in/crypto/story/crypto-collapse-intensifies-as-stablecoin-tether-slides- 
below-dollar-peg-333412-2022-05-13 


For instance, in the above market, market participants saw Tether fall below 98c. It is widely 
reported and verifiable that Tether fell below a dollar, we all agreed that we saw it, and the price 


traded almost 99c, but the candle didn’t appear on coingecko. 


httos://www.coin ko.com/en/coins/tether 


Coinmarketcap had it hitting 95c. But Coingecko had no candle on it. We resolved that market 


no as the ancillary data stated, “The primary resolution source for this market will be 


Coingecko's 30min candlestick low prices, with "Sun Jul 31 2022, 00:00:00" as the last relevant 
candle used for the market: https://www.coingecko.com/en/coins/tether.” 


| resolved this market to no. There was no dispute. 


UMA’s optimistic Oracle based on ancillary data worked. 


Final Result: Coingecko candle in resolution source > credible reporting 


2. 
The next market which made me believe it would be acceptable to propose the Eth 1,600 


market on Polymarket. 


https://polymarket.com/market/will-matic-reach-1-by-july-31 

Note the rules: 

The primary resolution source for this market will be CoinGecko's 30min candlestick high prices, 
with "Mon Aug 01, 2022, 00:00:00" as the last relevant candle used for the market. The 
resolution source can be found here: httos:/www.coingecko.com/en/coins/polygon. Note, this 
00:00:00 candle lists the opening price at 11:30:00 PM ET and the closing price at 12:00:00 AM 
ET. 


https://coinmarketcap.com/currencies/polygon/historical-data/ 


Traders, myself included, saw Matic trade over 1$ on many exchanges. This is seen on the 
Coinmarketcap for historical data for the day. The candle never appeared on Coingecko. So 


despite losing lots of money in this market, | did not dispute the correct resolution to no. 


No other Uman did as well, they respected our resolution source it resolved no, despite credible 
reporting that Matic reached $1.00. 


Final Result: Coingecko candle in resolution Source > credible reporting 

3. Every other crypto price market was resolved with data that would not be available in a 
dispute without question, which was verifiable for only 24 hours. Umans and Polymarket bettors 
had been fine with this for over a year. Usually the candles and credible reporting match and are 
equivalent 

Final Result: Coingecko candle in resolution Source = credible reporting, despite data 


not being available in case of dispute 


4. Real World financial markets 


There were some real-world examples thrown in the UMA chat of this. Robert did not read them. 
https://www.bloomberg.com/news/newsletters/2021-05-18/money-stuff-index-firm-forgot 
-to-update-xiv. They argued the index was reporting the incorrect prices, and the court 
threw out the case. https://archive.ph/Va7D8 Full text here, worth reading. 


There’s real-world precedent to resolution sources that aren’t accurate, but no court has 
ever thrown out the resolution source and based the resolution on a new source 


decided by the court. Uma is changing how markets function, just not in a good way. 


Restatement of Background 


Once again, these were the rules and the candle for the market in question. 


This market will resolve to “Yes” if Ethereum (ETH) has a candlestick closing price of $1,600.01 
or more, as per the resolution source, on August 26, 2022, 12 PM ET, and “No” otherwise. The 
resolution source for this market will be prices listed on CoinGecko 
(https://www.coingecko.com/en/coins/ethereum). This market will resolve according to the “C” 
(i.e. closing price) listed for the candle titled “Fri Aug 26 2022, 12:00:00”, with the “Price” tab 
selected, in the Eastern Time Zone. Note, this 12:00:00 candle lists the opening price for 
11:30:00 AM ET and the closing price for 12:00:00 PM ET. 


This was undeniably the closing candle below. 
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Important Coingecko Facts 


There are some nuances to Coingecko data. The candle in question rolls off every 24 hours. 
The candle is based on discretized trade data from the last 5 minutes weighted by volume 
across all different exchanges, including ETH/BTC, ETH/BUSD, ETH/USDT, and several other 
trading pairs. To close a candle, the next candle must start; before the next candle starts, the 
details of the previous candle are in flux. Before the last candle closes, the close price will vary 


wildly. 


Because Eth was trading at 1595 or 1590 on most exchanges at 12:00, the results were quite 
surprising. One trader saw it stuck at 1595 and sold yes down to less than a penny. When the 


final candle came out with 1600.07, the price went to 99.8c. 


The dispute was clearly because, at almost all exchanges, ETH traded below 1,600. But the 


rules specified a particular CoinGecko candle, which showed the price above 1600. 


Traders expressed frustration about CoinGeckos candle pricing, but all acknowledged the 
number it showed. 1600.07. 


Then, 24 hours after Coingecko puts out candles, new ones replace the old ones. The exact 
resolution source could no longer be viewed and was not verifiable via API or Coingecko’s site. 
When the market had been proposed, no one in the UMA chat disputed CoinGecko’s closing 
price at noon once the candle closed was 1600.07. Coinmarketcap has a closing price of 1600.4 


as well, using a similar delayed aggregation system. 


When the data disappeared, as it is supposed to do 24 hours after new data comes in, the price 
for no went to 5c during the dispute. People start arguing that the CoinGecko candle we all 
discussed yesterday never existed and can’t be verified. There are thousands of messages in 
the Uman discord acknowledging the 1600.07 settle candle. Note the open for the new 4H 
candle at the time of resolution is also 1600.07, weird coincidence. It’s also verifiable that all 30 
minute candles have another property as well the last line price graph point before a new 


candle, is the close price of that candle. This also was 1600.07. 
The UMA Schelling Point Problem (Exemplified by Robert Leshner): 


| voted 0 (no). I’m a whale, follow me, or you won’t make UMA! 


© Robert 
| voted O; my reasoning posted in HO 


evidence-rationale . Seems pretty clear cut 
to me. But you all do whatever you think 
best. 
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Data disappearing took the market from .5c to 5c. Some people thought if Umans couldn’t see it 
that could be enough. People who originally were on yes switched sides to take advantage of 
this opportunity. The above comments from Leshner, took the market from 5c to 40c. No 
Polymarket bettor expected UMA to overturn the market based on the data presented, and the 
prices reflected market expectations. It was 10x greater than before data disappeared but still 
very likely to resolve yes. Leshner admitted being unfamiliar with betting markets at all, but still 


was confident he was answering the proposal correctly and consistently. 
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The main reason UMA should not be used as an oracle for a specific contract with a specific 


resolution source became clear. There is an enormous incentive to vote with an incorrect 
ill-informed UMA whale over a well-informed correct minnow. The thing about UMA is that when 
a whale tells you how they will vote, and you think they have enough votes to swing the result, 
you should not vote against them. Truth and correctness will not matter in how much you 


receive if you don’t vote with the majority 


UMA is inflationary. You earn rewards by voting on the same side as Robert Leshner and other 
UMA stakeholders with 900k+ tokens. Robert made this post without reading any of the 1,000 
messages earlier in the chat. He did not ask if Umans had independently verified the candle 
when it was available. He did not ask does the data need to be there at the time of dispute or 
proposal of the market? He didn’t ask how do Coingecko candles work? He asked none of the 
essential questions, didn’t ask about precedent on Polymarket, listened to one person make 
arguments and pictures of ETH close on particular exchanges, and suggested overturning 100+ 


markets with precedent. Umans were almost guaranteed to follow him due to the incentives! 


If Robert had said, “I’m voting yes. Vote with me if you want to make money.” it’s clear that the 


Umans would have voted with him as well. They make Uma by voting with whales, not by 


finding the truth. If the Schelling point is wrong, UMA should go down in price, but as a token, 
that’s fallen 95%, it only has 100% further to fall, and if the only people who care about it are 15 
Polymarket traders, it won’t affect the price. But UMA should consistently make the same 
decisions based on the same specific resolution source. They do not. Inconsistency is a fatal 


flaw in an optimistic oracle. 


Other companies like Across and Hop protocol are completely unaware of the risks. If you follow 
the UMIP down to the letter of the code in ancillary data, an Uman whale has no incentive to 


find the truth, just to be the first to loudly announce the way he’s voting. 


This vote fundamentally shifts the future of optimistic oracles as prediction market resolvers. 
Previously we were told by both UMA and Polymarket that the optimistic oracle wouldn’t 
overrule precise rules. Only in cases of ambiguity in the regulations would there be a dispute to 
make a decision. You only had to verify the data at the time of the proposal, not guarantee the 
veracity 24 or 48 hours later. This data source was good for the last 100 markets, but not this 
one. The UMA protocol was pitched as a good emergency clarifier for vague rules, not to 


overwrite specific ancillary data; they can and will do this, though! 


Conclusion: 


UMA, the optimistic oracle, was meant to clarify vague rulings and prevent early resolution of 
Polymarket Markets, where the rules aren't as clear. This was not the case. Umans can decide 
the Coingecko resolution source is correct when it differs from the reporting from other parts of 
reality for two markets in a row, and is sufficient as a data source for 100. Umans can then 
suddenly decide Polymarket bettors should use different features of reality instead of the 
hardcoded resolution source that UMA and Polymarket had always used. This is also all after 
the market is over and everyone traded like Umans previous policy of respecting coingecko 


resolutions would continue. 


Hell, even the CEO of polymarket agrees that Robert was wrong. 
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“ there's not really any ambiguity around the candle close referenced in 
the market rules being $1600.07 
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Luckily for Robert. 


| did not realize that bugging the UMA whales to vote incorrectly could generate a large amount 


of profit in these markets they pay almost no attention to. 


An oracle where the proposal and dispute are both correct is no longer answering questions 


about the state of the world but is instead answering a question about the dispute process. 


My confidence in UMA and as a consequence, Polymarket, is shaken for the time being. 
Of course, I'll still be trading on Polymarket, but I’d steer anyone asked away from UMA. 


I've never written a bear piece on crypto, I’ve seen many terrible cryptocurrencies, lve 


used a few, and just shake them off. However | have to keep using 


More than anything, neither the Umans nor the Polymarket team could tell me what | 
could have done to avoid proposing yes on this market. Still, it was guaranteed to fail 
and lose $4,000, despite everyone telling me that was the only answer | could have 
proposed at the time. An Uman told me even though all the ancillary data was yes, the 


schelling point ended up being no, 


To Polymarket’s credit, the CEO did reach out to me to see what they could do to make 
it right, but their hands are tied here for regulatory reasons. Umans seemed happy with 


how their system performed. 


| hope Polymarket moves off the UMA Optimistic Oracle protocol for asset prices or 


sports markets. I’m pessimistic about their potential to create certainty for traders. 


To any company considering partnering with UMA, | highly encourage you to 
understand the risks they ignore your ancillary data and decide things for themselves 
against all precedent. Don’t partner with this company people. It’s just whales deciding 


whatever they want. 


